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Abstract. We consider parameter identification problems in parametrized partial 
differential equations (PDE). This leads to nonlinear ill-posed inverse problems. 
One way to solve them are iterative regularization methods, which typically require 
numerous amounts of forward solutions during the solution process. In this article 
we consider the nonlinear Landweber method and want to couple it with the reduced 
basis method as a model order reduction technique in order to reduce the overall 
computational time. In particular, we consider PDEs with a high-dimensional 
parameter space, which are known to pose difficulties in the context of reduced basis 
methods. We present a new method that is able to handle such high-dimensional 
parameter spaces by combining the nonlinear Landweber method with adaptive online 
reduced basis updates. It is then applied to the inverse problem of reconstructing the 
conductivity in the stationary heat equation. 
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1. Introduction 

The numerical solution of nonlinear inverse problems such as the identification of a 
parameter in a partial differential equation (PDE) from a noisy solution of the PDE via 
iterative regularization methods, e.g. the Landweber method or Newton-type methods, 
see, e.g., mum for a detailed overview, usually requires numerous amounts of forward 
solutions of the respective PDE. Since this can be very time-consuming, it is highly 
desirable to speed up the solution process. 

The reduced basis method, see, e.g., [25119] for a general survey, is a model order 
reduction technique that can yield a significant decrease in the computational time 
of the PDE solution, especially in a many-query context. The classical reduced basis 
framework aims at constructing a global reduced basis space that is a low-dimensional 
subspace of the solution space of the PDE providing accurate approximations to the 
PDE-solution for every parameter in the parameter domain. A possible way to construct 
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such a space is to select meaningful parameters and choose the corresponding PDE- 
solutions, the so called snapshots, as basis vectors of the reduced basis space. Via 
Galerkin projection of the problem onto the reduced basis space, the reduced basis 
approximation can be computed. An offline/online decomposition of the procedure 
allows for the efficient and rapid computation of the reduced basis approximation 
for many different parameters. Using a global reduced basis space, one can replace 
the expensive forward solution or a functional evaluation of it with the corresponding 
reduced basis quantity in the solution procedure of a given inverse problem. We call 
this the direct approach and it has successfully been applied to various problems, see, 
e.g., pi EH US], but we want to stress that in those references the parameter space 
was bounded and of low dimension, which is required for the construction of a global 
reduced basis space. 

The contribution of this paper to the held is the application of reduced basis 
methods to a parameter identification problem with a very high-dimensional and 
unbounded parameter space. To this end we want to study the inverse model problem: 
given a solution u(x), x G hi, of 

V ■ (a(x)Wu(x)) = 1, i 6 fl, and u(x) = 0, 16 dVL, (1) 

identify the parameter er(x), with h C l 2 a bounded domain. This is an example of 
recovering an image of the thermal conductivity in the stationary heat equation with 
constant heat source. Typically, instead of a a noisy measurement u s is known, with 
||w — m 5 || < 5 and noise level 5 > 0. Since this problem is ill-posed, regularization 
techniques have to be applied. We choose the nonlinear Landweber method in this 
article. 

The aim of this paper is the development of a new method to solve nonlinear inverse 
problems with high-dimensional parameter spaces, where our approach is based on the 
ideas developed by Druskin and Zaslavsky | 6 ]. We will combine the nonlinear Landweber 
method with the main ideas of the reduced basis method: instead of constructing a 
global reduced basis space, providing accurate approximations for every parameter in 
the parameter domain, as it is usually the case in reduced basis methods, see, e.g., [5], 
we will adaptively construct a small problem-specific reduced basis space that may only 
be useful for the reconstruction of a single conductivity. This will break the typical 
offline/online framework of reduced basis methods. A critical question then will be the 
selection of the snapshots for this problem-oriented space. We will develop termination 
criteria that, together with the nonlinear Landweber method projected onto the current 
reduced basis space, will not only select meaningful parameters for space enrichment 
but also serve the solution of the posed inverse problem. Therefore, we adaptively 
enrich our reduced basis space to fit the region of the parameter space that is required 
to reconstruct the desired conductivity, while also reconstructing it. This will allow 
for the numerical treatment of very high-dimensional parameter spaces. We note that 
the nonlinear Landweber method being a regularization method has been extensively 
studied and analyzed, see, e.g., MEmm 
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Ideas similar to our adaptive approach have been applied to a parameter estimation 
problem arising from the modeling of lithium ion batteries [ 20 j, a subsonic aerodynamic 
shape optimization problem [29], both leading to an optimization problem constrained 
with a nonlinear PDE, and a Bayesian inversion approach, where the parameter is 
modelled as a random variable, using Markov chain Monte Carlo (MCMC) methods [3]. 

The remainder of this paper is organized as follows. In Section [2] we will present 
a mathematical formulation of the model problem, for which the nonlinear Landweber 
method is known to converge locally. Section [3] contains a brief discretization as well as 
the key ingredients of the classical reduced basis method. In Section [4] we will develop 
the new method, comment on its implementation and present numerical results. Final 
conclusions are drawn in Section [5] 

2. Problem formulation 

We present a well-known setting in which the Landweber method applied to ([1]) does 
converge locally. Throughout this section we assume C M 2 to be a bounded domain 
with C 2 -boundary. Following [16, 11] HE], we choose the parameter space 

R 2 (f2) := {a(x) G | essinfa(x) > 0}, 

with H 2 (Q) the usual Sobolev space. Since has a (^-boundary, H 2 (Q) embeds 
continuously into L°°(f2), cf. [lj Theorem 4.12], such that taking the essential inhmum 
of a function in H 2 {yi) is a continuous mapping and is an open subset of H 2 (Q). 

We consider the PDE: for given cr(x) G End the (weak) solution u G of 

V • (a(x)Vu(a:)) = 1. ( 2 ) 

The corresponding parameter-to-solution map is defined as 
T : V{T) := H\ (O) C H 2 (tt) —> L 2 (D) 

T{cr) = u u G hfd(D) C L 2 (f2) solving 

b(u,w, a) — f(w) for all w G (3) 

b(u,w;a) := / a'Vu-'Vwdx , / wdx. 

Jn Jn 

The associated inverse problem is 

for u G L 2 (f2) find a G i/ 2 (f2) such that J-(cr) = u. (4) 

Typically, instead of u a noisy measurement u 6 G L 2 (Q) is known, with Hu 15 —u|| l 2 (Q) < ^ 
and noise level 5 > 0 , such that regularization techniques have to be applied since simple 
inversion fails due to the ill-posedness of the problem. Throughout this paper we assume 
the knowledge of 5. 

Remark 2.1. 

(i) For a G R 2 (D) we have \b(u,u;a)\ > a(a) ||u|[ 2 L 2 ^, with ct(cr) := , ' bbl ^ r7 ^F > o, 
where Cpf is the Poincare-Friedrich constant of it. Therefore, the bilinear form 
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6 (-,-;er) is coercive for all a G H+(Q). Since H 2 (Ll) embeds continuously into 
L°°(n), b is also continuous for every a G H 2 {Vt) with continuity constant 
7 (a) := esssup cr(:r) < 00 . The linear form f is continuous as well such that 
the Lemma of Lax-Milgram guarantees existence and uniqueness of a solution of 
( 131 ) in Hq (Q). 

(ii) L 2 (Q) is chosen as the image space of T because we consider it to be more realistic 
for a measurement u 6 G L 2 (Q) to be close to the exact data u G in the 

L 2 -norm rather than in the H 1 -norm. 

(Hi) We acknowledge that the inverse problem stated in (J4|) is actually a linear problem 
since the data u G L 2 (fl) is known over the whole domain The problem becomes 
truly nonlinear if the data is only known on a proper subdomain 0 C 0. We 
formulate this partial inverse problem 

for u G L 2 (yt) find a G H+lVt) such that E(a) = u, (5) 

with T := E o T and a restriction operator E : L 2 (Q) —)■ L 2 (Cl). Since the scope 
of this work is the connection of iterative regularization methods and the reduced 
basis method, we will continue to consider (SJ) for reasons of simplicity. Still, the 
resulting method derived in Section [3] is applicable to the partial problem (J5]) and 
we will provide corresponding numerical results in Section \f73 [ 

(iv) We mention that in the chosen setting (but also in general) the inverse problem 
(J4J) (and more so (J5 ]) ) is not uniquely solvable. In ITfl) Ito and Kunisch provide 
an overview of existing results on this topic and show the injectivity of T with 
respect to a reference parameter under certain assumptions. A recent result on the 
uniqueness o/d4j with C 2 -parameter is given by Knowles m. where his techniques 
are based on the work of Richter 


If we consider = L°f(Q) C L 2 (Q) as definition space of T, it is a well-known 

result that for each cr G L^(Q) and each direction k G L 2 (Q) with u + kG L™(Q) (note 
that L^°(h 2 ) is not an open subset of L 2 (fl)) 


lim 

K'W 00—>0 


II + k) - E(a) - L 2 (q) 



0 


( 6 ) 


holds, with a linear and continuous operator T\a) given by 


JV)(-) : L 2 (Q) ~^L 2 {Q) 

T\<7)k = v v G C L 2 (fi) solving 

b(v,w ; a) = g(w, k) for all w G (^) 

b(v,w;a):= / aVv-Vwdx, g(w;n):=— / rV?/ • Shu dx, 

Jn Jn 

where u a abbreviates J-(cr). The Appendix of this article contains a proof of the above 
statement. Since H 2 (Ll) embeds continuously into L°°(fl) and H'f(Q) is an open subset 
of H 2 (Ll), ([ 6 D holds for every a G H+(Q) and k G H 2 (Q), where T'{c r) considered as an 
operator from H 2 (fl) to L 2 (fl) is the Frechet derivative of T. 
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To numerically solve ([3]), we consider the nonlinear Landweber iteration that is 
based on the fix point equation 

a = £(a) := cr + uF'(a)*(u — F(a)), 

where J-'(cr)* denotes the adjoint of T'(a) and lu > 0 is a damping parameter. With 
given noisy data u 5 G L 2 (Q) we can only expect to reconstruct an approximative solution 
a 5 to an exact solution cr + G of ([4]). The damped nonlinear Landweber iteration 

is defined via 

4+1 + n — 0,1 ,... (8) 

with starting value erg £ H+(Q), which may incorporate a-priori knowledge of cr + , and 
damping parameter lu chosen as cu < || J r/ (cr + )|| ” 2 - Since we consider noisy data, the 
iteration (jEj) has to be stopped properly to prevent error amplification. We choose the 
well-known discrepancy principle: accept the iterate &n*( 5 u s ) as a s °l u ti° n to (J4j), if it 
fulfills 

ll jr ( cr n*( 5 ,^)) - uS \\LRU) <rS < \\F{a 5 n ) - u s II L 2 (q) , n = 0,1, ..., n*{5, u 5 ) - 1, (9) 

with r > 2. In this setting the damped nonlinear Landweber iteration applied to (jJJ) 
for noisy data is known to locally converge. 

Proposition 2.2. Let a + G T)(F) be a solution of F(cr) = u. Then, there exists a 
radius p > 0 such that the following holds for every starting value <7 q G B p (cr + ): if the 
damped nonlinear Landweber iteration applied to noisy data u 5 G L 2 (Ll) is stopped with 
n*(5,u 5 ) according to (j9]) 7 then converges to some solution a of IF (a) = u as 

5^0. 

Proof. Since H 2 {Ll) embeds continuously into L°°(Q) and therefore H+(Q) is open 
as mentioned in the beginning of the section, we can always find an open ball 
£> n (cr + ) C T)(F) = Hf(Q) around a + with rq > 0 such that ess inf (cr) > c\ for all 
a G B ri (a + ), where C\ depends on ess inf (a + ). Furthermore, the triangle inequality 
yields ||a|| H 2 (n) < ||cr - a + ||^ 2(n) + ||a + || H 2 (Q) < r 1 + ||(7+|| ^ (n) =: c 2 for every 
cr g B Tl (t7 + ). We mention that H+(Q) is convex. Hanke showed in pT] Corollary 
3.2] that 

\\Ha) ~ F{,v) - ~ &)\\L*(n) < C'Hcr - a\\ H 2 ^ || F{a) - .F(5-)|| L 2 (n) 

holds for all a, a G B ri (a + ), where C depends on c\, c 2 and 12. Therefore, there exist 
0 < r 2 < rq and rj < | such that the tangential cone condition 

\\r{°) ~ - d)|| L 2 (n) < 7]\\F(a) - J r (d)|| L2(n) 

is true for all cr, a G B r2 (a + ). We now choose r in (J9j) as 

r > 2 > 2. (10) 

1 — rj 

Finally, we can find 0 < r 3 < r 2 such that ||J r/ (cr)|| < < i for all 

cr G B r3 (a + ). We now choose p = y such that for every crj) G B p (cr + ) all assumptions of 
[SI Theorem 11.5] are fulfilled and the assertion follows. □ 
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(%) Hanke \12f extends the convergence result of |3, Theorem 11.5/ to choices r > 1. In 
the same article Hanke also mentions that the solution cr found with Theorem 12.21 
depends on the starting value erg and does not need to coincide with a + if F'(a + ) 
happens to have a nontrivial null space. 


(ii) Since in a practical application a + is unknown, we will make a heuristic choice of 
the damping parameter ui in SectionUVS. 


3. Reduced basis methods 

Before we introduce the key ingredients of the classical reduced basis method and for 
further numerical treatment, we discretize our model problem. 


3.1. Discretization 

We introduce a standard finite element space and a discrete parameter space. Note that 
the unit square, despite lacking a C 2 -boundary, still meets the demands on the domain 
required for the theory in Section d Therefore, we choose 12 := [0, l] 2 as computational 
domain for the remainder of this article. 

Definition 3.1. For a given n & N, n > 2, we choose a uniform triangulation of 12 
with (n + 2) 2 grid nodes Xi and R n the index set of inner nodes. We use piecewise linear 
nodal basis functions, denoted as (p i7 i G I m , on the inner nodes. The discrete function 
space Y then is defined via 

Y {u : 12 —>■ M | u(x) = Uiipi(x), Ui G M, i G /j n }. 

i£lin 

Y is equipped with the L 2 -norm and and for u G Y let u = ( uf)i & i in G M ” 2 denote the 
vector of coefficients. 

Definition 3.2. For a given square number p = q 2 , q G N, we divide 12 into a uniform 
partition of p squared subdomains 12,, i — 1,... ,p, and define V p via 

p 

V p := {a : 12 ->• R | a(x) = V e K + := (0, oo), i = 1,.. .p}, 

i—1 

with xn, being the characteristic function on the subdomain 12j. V p is equipped with the 
L 2 -norm and for a G V p let a = (cq)f =1 G M 1 / denote the vector of coefficients. 

Remark 3.3. In Defntion \3.2\ we choose piecewise constant functions for our discrete 
parameter space. This choice resembles the common numerical setting for the inverse 
problem tackled in this paper, where no continuity for the searched for diffusion 
coefficient can be assumed. Note that this choice is not consistent with H 2 ( 12), the 
parameter space in Section d and therefore the result of Proposition 1 2.2\ does not need 
to hold in this discrete setting. Also, to our knowledge, it is an open question if the 
tangential cone condition required in the proof of Proposition 12.21 holds in this discrete 
setting. 
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The following discrete problems will have R^ and R p as definition space. Note the 
isomorphisms between R^ and V p as well as R p and its (analogously to Definition 13.21 
defined) function space. Furthermore, we recall that b, f and g are the bilinear and 
linear forms introduced in Section [2] and the stability constants of b , f and g carry over 
to Y and R+ such that existence and uniqueness of the discrete problems are guaranteed 
via Lax-Milgram. The discrete forward operator is given by 

F : R+ » Y, <t i y u a , u — «) ieJin solving 

B(tr)u = f with (B(e r)) 0 - := b((pi,(pj;a), (/)* := /(<?»), i,j G I in . 

The associated discrete inverse problem is 


for u a G Y find er e R+ such that (fill) is fulfilled. (12) 

In the upcoming sections u a , the solution of (fill) , will simply be denoted by u. For 
<r G R+, the Jacobian F'(a) is given by 

F'(<r)(-) : R p —> Y, n ^ y <, v = «*) solving 

ie * n (13) 

B(a)v = </(«) with B(cr) as in (HIT) and (g(n))i := g(ipi ; k), i G . 

Remark 3.4. Since we use the L 2 -norm instead of the energy-norm on Y, it is 
a(cr) := > 0, for all a G V v , the coercivity constant of b with respect to Y. 

For = [0, l] 2 we refer to the proof of /7J Thm. 6.30/ and choose Cpf = ^ such that 
we use Oi(cr) = 2min(<r) > 0 for all a G V v throughout this article. 


3.2. The reduced basis method 

Reduced basis methods aim at constructing a low-dimensional subspace Yjy of Y, with 
N = dim Y n <C dim Y = n 2 , such that the reduced basis solution u^ is an accurate 
approximation of u, the high-dimensional forward solution of (ITT]) . Typically Yn will 
consist of so called snapshots that are solutions of (TTT1) to meaningful parameters. We 
will not discuss the construction of Yn in this section but assume a reduced basis space 
to be given. In order to give a brief overview of the reduced basis method, this section is 
kept very generic. For a detailed survey of the reduced basis method we refer to pa ij. 

Definition 3.5. Let a forward operator (1TTT) and a reduced basis space Y N C Y, with 
dim Yn = N and basis 4V := {Vh, • • ■, f/tv}? be given. We define the discrete reduced 
forward operator 

N 

Fn : R+ —> Y n , cr i—> u a N = Wv = {u a Ni )f =1 solving 

i= 1 v / 

B n (<j)u n = f N with (B N (cr))ij := b^ifj] a), ( f N )i := /(^*), i,j = 1 , ..., N. 

We call u a N the reduced basis approximation and will often write un instead. 

Remark 3.6. 

(i) Existence and uniqueness of (fT4l) follow from the properties of (ITT]) . 
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(ii) If the reduced basis is orthonormal, cond (B N (cr)) < holds independent of 
N with B n (<j) defined in (1T4T) . 

For the sake of completeness, we include the proof of the well-known rigorous error 
estimator for the reduced basis error, here measured in the L 2 -norm, \\u — utvII l 2 (Q), cf. 
[25] or pi Proposition 2.15 & 2.19]. 

Lemma 3.7. For a G V p we define the residual r(-; er) G Y' via 
r(v; a) := f(v) - b(u N , v; a ), v G Y. 

Then, let v r G Y denote the Riesz-representative ofr(-;a), i.e., 

(v r ,v) L 2 m =r{v\c r), v G y, ||n r || L 2 (n ) = ||r(-; a)\\ Y >- 
Then, the error u — 6 Y is bounded for all a G? p by 

K|| L 2 (0) 


\u — Mat11 l 2 (0) < Aat(ct) 


a cr 


(15) 


Proof. Introducing the notation e := u — we can calculate 

6(e, v; a) = 6(w, u; a) — b(ux, v, a) = f(v) — b(uN, v; a) = r(v; a) for all v G Y. 


Testing this equation with e G Y yields 

«( cr ) l|e|l i 2 (r2) < & (e,e;a) = r(e;cr) < ||r(-; cr )|| Y > ||e|| L 2 {n) = ||v r || L 2 (n) ||e|| L 2 (n) . 

Division by ||e|| and a(cr) concludes the proof. □ 


We want to remind the reader that this is an estimator for the error between the 
reduced basis approximation and the discrete forward solution. Since the construction 
method for Y N in Section [4] will be snapshot-based, we note an important property of 
such methods, the reproduction of solutions. It guarantees exactness in the reduced 
basis approximation for parameters whose snapshots are part of Y N . 

Lemma 3.8. Let a G V p , F(cr), Fn(ct) be solutions of (ITT]) and (fT4l) and e* G the 
i-th unit vector. Then the following holds 

(i) if F(cr) G Yjy then Fn(ct) = F(a). 

(ii) if F{cr) = ^ 6 then u N = e, G M. N . 


Proof. Immediately follows from dll]) and (ITT]) , see, e.g., [21 Proposition 2.16]. □ 


To conclude this brief overview of the reduced basis method we present both 
offline/online decompositions of (ITT]) and the error estimator (1T5]) that allow for the 
rapid computation of % and A N . The essential assumption for those decompositions is 
that the bilinear form b and the linear form / are parameter-separable, which is fulfilled 

by (HU). 
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Corollary 3.9. Using the notation of Definition 1 3. 6 A the set {a^(x),... ,a^(x) \ 
a^(x) = Xfii(x), i = 1 is a basis of V p with corresponding coefficient vectors 

cr© = e* G M p , i — 1,... ,p, e* being the i-th unit vector. Therefore, we can rewrite b 
and f as 

Qb Qf 

b(u, v ; a) = ^ Q q b (rr)b q (u , v), f(v ; a) = ^ Q q f (cr)f q (v ), 

5=1 5=1 

for all u,v E Y and a E Pp, with Qb — P, Qf — 1 coefficient functions ©^(cr) : = 
q = 1,... , p, ©}(cr) := 1 and components 

6 9 (n,u) := 6(n,n;o- (9) ), g= l,...p, / x (n) := f(v), u,v E Y. 


If the bilinear form b and the linear form f can be rewritten this way, they are said to 
be parameter-separable. Regarding the residual we set Q r := Qf + N ■ Q b = 1 + N ■ p 
and define the components of the residual r q E Y', q — 1,..., Q r via 

(r 1 ,..., r Qr ) := ..., f Qf (■), •)>■■•» ^‘(V’l, ■)>■■■> ■)>■■■> ■)) 

= (/ 1 (0» ■)>•••> ■)>■■■> &1 (^iv, ■)>■■■> ■))> 


and let if E F denote the Riesz-representative of r q . For u a N = Yl!i=i u( Ni^i a solution 
of ([HD we define the corresponding coefficient functions Q q (cr), q = 1,,Q r via 

(el,..., e?') := (e},....e®',-0X,„• • •,-0 ?‘«k,i.....- ej^,....-e?‘«Sr, K ) 

= (1) — ( cr )l' u Af,l; • • • > (^? ■ ■ • ) — ( cr )l M AT,7V) ■ ■ • j ~( (t )p u N,n)- 

Using this, the residual r and its Riesz-representative v r are parameter-separable as 


r(v, a) = ^ O q r (cr)r q (v ), v r (a) = ^ 

5=1 5=1 

For problems that are not parameter-separable, the empirical interpolation method 
is available. The general idea of an offline/online decomposition is: compute all 
parameter independent quantities in a nonrecurring possibly expensive offline phase 
and then, for every new parameter, rapidly compute the desired quantity in the online 
phase. We first formulate the offline/online decomposition of (fl4l) . 


Procedure 3.10. 

Offline phase (one-time) 

(i) Generate reduced basis = {f>i ,..., V’w} and Y N . 

(ii) Galerkin projection of components onto Yn, i.e., compute B q N := ib q {f>i,f>j))^. =l E 
R NxN and f q N := {f q {ifi))ti G R N . 

Online phase (for each new a G V p ) 

(i) Evaluate coefficient functions Q q (cr), Q q (cr), assemble B N (cr), f N and solve linear 
system in m. 

(ii) Reconstruct reduced basis solution % = YliLi u N,i'fi- 
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Since the online phase only involves linear combination and the solution of a 
linear system of dimension N, with N -C n 2 , it is very cheap. We conclude with 
the offline/online decomposition of the residual norm ||tv|| £,2^ and therefore the error 
estimator. 


Procedure 3.11. 

Offline phase: After the offline phase of Procedure 1 3. 1 (A compute the matrix G r : = 
Online phase: For given a £ V p and corresponding u a N , evaluate Q r : = (0* (cr))^ £ 


and compute ||'iv||z, 2 (n) = y ® r G r @ r . 


4. Reduced Basis Landweber (RBL) method 

Before we develop the Reduced Basis Landweber (RBL) method, we introduce needed 
results and comment on the alternative direct approach that was mentioned in the 
Introduction of this paper. 


4-1. Preliminaries 

With the notation introduced in Section 13.11 the nonlinear Landweber iteration defined 
in (|H]) applied to (1T2ll is reasonable. As mentioned in Section [2] we consider the damped 
nonlinear Landweber iteration with damping parameter uj > 0 terminated with the 
discrepancy principle as it is stated in Algorithm [0 

Algorithm 1 Landweber(<r start , r) 

1: n := 0, <Tg := cr start 

2: while H-F(er^) - u s || L 2 (n) > r6 do 

3: cr 5 n+1 := cr 5 n + uF'(a s n )* (u 5 - F(cr s n )) 

4: n := n + 1 

5: end while 
6 : return cr LW := cr 5 n 


In the upcoming sections we will write <Jlw to denote the element in V p 
corresponding to cr LW . We introduce a dual problem that allows for a simple calculation 
of the Landweber update in line 3 of Algorithm [0 

Proposition 4.1. For cr £ k, £ R p and l EY it holds 

(k,F , (<t)*1) 2 = (F , ((t)k,1) l 2 (n) = [ W /-Wuf dx, (16) 

Jn 

with F'(cr)* the adjoint of F'(cr) and uf £ Y the unique solution of the discrete dual 
problem 

B(cr)u = m(l) with B(cr) as in Dli and 

(m(l))i := mfpi ; /):=-/ <# l dx, i £ I in . 

Jn 


( 17 ) 
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Proof. Note that uf G Y solving (TITT) is equivalent to uf solving b(uf,v;a) = m{v) for 
all v G Y. The hrst equality in (1T6]) is the definition of the adjoint. The second equality 
follows from (fT3l) and (1T7T) 


(F'((t)k, 1)l 2 (ci) — / F\cr)K,ldx= / v a K ldx=— / aWuf -Vvfdx 
Jfi Jet Jq 

= / reVrU ■ Vuf dx. 


□ 


Using Proposition 14.11 we calculate the Landweber update in line 3 of Algorithm 
CO For a G V p , l G Y let u a = Y^ia in u i^ and u ° = ufppi G Y be solutions of 

(1TTD and (fTTj) with corresponding coefficient vectors u a = (uf) ie i in and uf = {ufi)i e i in 
such that it holds for kGK p 




kVu 0 " • VuJ dx = 

ijehn 


« ■ / nVipi ■ X7tpj dx 


= ( ua ) J B ( k ) u i- 

ijehn 


(18) 


Therefore, we can evaluate F'(cr)*l for given a G V p , l G Y by consecutively 
inserting a basis vector of M p as the parameter n. Following Corollary 13.91 we 
choose the standard basis of such that B(k) in (fl8ji is the fc-th component matrix 
B k := (b k ((fii, ipS). if re is the fc-th unit vector. Using this, the calculation of the 
Landweber update in line 3 of Algorithm |T] consists of the following steps. 


Procedure 4.2. 


1. Compute the primal forward solution of cm. Define l := u s — . 

2. Compute uf n the dual forward solution of (H71) . 

3. Evaluate the Landweber update 

(F\<T S n Y(u‘ - F(cr‘ rl ))) k = (u’") T B k u?-, k= 1,... ,p. 

We conclude this preliminary section with a extensive comment on the alternative 
direct approach to couple reduced basis methods and the Landweber method. 


Remark 4.3. Due to Procedure f.2. every Landweber step contains two forward 


solutions and Algorithm Q] as an iterative regularization algorithm provides a many- 
query context such that the application of reduced basis methods is intuitive. The direct 
approach consists of constructing one global reduced basis space, yielding accurate 
reduced basis approximations for all a G V p , per forward problem and replacing the 
corresponding forward solution required in the Landweber iteration with its reduced 
counterpart. We note that this methodology surely could be applied to other regularization 
algorithms as well and that similar techniques have successfully been applied to problems 
with a low-dimensional parameter space, see, e.g., !22l H?7l T3j . The application of this 
direct approach to our model problem is limited for two reasons. First, concerning CD, 
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it is possible to construct a global reduced basis space via e.g. the well-known greedy 
algorithm, see, e.g., Concerning 113, due to the varying right hand side, 

this is not possible. Therefore, we could only speed up one of the two forward solutions 
such that this approach would be inefficient for the chosen model problem. Second, global 
reduced basis spaces can only be constructed when the parameter space is bounded and 
of low dimension (say up to 100, where in various methods to construct 

such spaces are presented) and therefore it is not feasible for our purpose that lies in 
imaging. 

4-2. Development of the method 

One way to couple reduced basis methods and the nonlinear Landweber method is the 
direct approach that was discussed in Remark 14.31 which had several drawbacks. In this 
section we want to develop a new method that overcomes these drawbacks via adaptive 
online updates of the reduced basis space during the solution process of the inverse 
problem. Online updates in model order reduction have also been considered recently 
in other contexts 

We no longer aim at constructing a global reduced basis space that could be used 
for the reconstruction of every a G V v . Instead, for a given measurement, we aim at 
adaptively constructing a small problem-oriented reduced basis space Y/v, i while also 
solving the associated inverse problem. Therefore, Yjv ,i aims only at a specific yet 
unknown region of V p that is relevant for the solution of the inverse problem. This 
breaks the typical offline/online framework of reduced basis methods but the resulting 
method will still have offline and online segments. Nevertheless, the procedure provides 
considerable acceleration of the computational time. 

For the construction of this problem-oriented space we use the nonlinear Landweber 
method projected onto the current reduced basis space as a criterion to select 
meaningful parameters. These are then used to enrich the reduced basis space with 
the corresponding snapshot. By this choice we construct a reduced basis space that is 
tailored around the inverse problem in the sense that it provides accurate reduced basis 
approximations for parameters lying in the a priori unknown region of the parameter 
space that is relevant for the solution of the inverse problem. Simultaneously the inverse 
problem is solved in this process. Since the Landweber method makes use of the adjoint 
of the derivative, we introduce a second reduced basis space Yn ,2 containing the required 
information. We gather these thoughts. 

Procedure 4.4. 

1. Start with an initial guess a start £ V p and initial possibly empty spaces Yjv, i, Yv,2- 

2. Update the spaces Yjv,i, Y/v,2 using the current iterate. In the first step use cr start- 

3. Solve the inverse problem up to a certain accuracy with the nonlinear Landweber 
method projected onto Y N} i and Y N 2 and thus determine a new parameter for space 
enrichment. 
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4. If the current iterate fulfills (19]), terminate, else go to step 2. 

For now, we treat the update of the reduced spaces and the projected Landweber 
method as modular blocks of our procedure and elaborate on these after the final 
algorithm has been presented. First, we need to find meaningful termination criteria 
for the projected nonlinear Landweber method in step 3 of Procedure 14.41 Let in the 
following u G Bp be the current iterate of the projected method. 

Terminating with a high-dimensional discrepancy principle as soon as || F(cr) — 
u 6 \\l 2 (q.) < t 5 is out of question since we do not want to compute the expensive 
solution of (TITjl in each iteration. Instead, we want to terminate via a low-dimensional 
discrepancy principle as soon as ||F/v(er) — u s \\l 2 (q.) < t 5. Taking a look at 

||F(cr) - M 5 || i 2 (n) < ||F(cr) - F N (tr) || L 2 (n) + ||Fjv(<r) - u 5 \\ L 2 (n) , (19) 

\\F N (cr) - u s \\ L 2 ( n) ~ \\F N (cr) - F(cr)\\ L 2 (n) < \\F(a) - u s \\ L 2 {n) , (20) 

we can see that ||F(cr) — u 5 \\l 2 (ci) and ||F)v(cr) — w 5 ||L 2 (n) are connected via the reduced 
basis error ||F/v(<r) — F(cr)\\ L 2^ that will grow over the course of the projected 
Landweber iteration since each consecutive iterate will be worse and worse approximated 
by the current set of reduced basis spaces. Therefore, we want to control this error which 
can be done using the rigorous error estimator A n introduced in Lemma 13.71 As long 
as a does not fulfill the reduced discrepancy principle (r — 2)5 is a reasonable upper 
bound for Av since it follows from (l20l) that ||F(cr) — u 8 \\l 2 {vl) > 25 (and therefore a 
is rejected by fl9]) as well) as long as Aat(ct) < (r — 2)5. This is a strong motivation to 
suggest the termination of step 3 of Procedure 14.41 if one of the following criteria is met 

||fbv(er) - m‘ 5 || L 2 ( n) < t 5 or A N (er) > (r - 2)5. (21) 

The latter alternative termination criterion in ()2T1) is in fact a trust region criterion: 
as soon as the error estimator grows too large we cannot ensure that the error 
||.F/v(cr) — F(cr)|| L 2 (n) stays small enough, thus we do not trust the current reduced 
basis spaces anymore (they might not produce feasible approximations anymore such 
that further iterations might be misleading) and enrich them using the current iterate. 

We add these thoughts to Procedure 14.41 and call the resulting new method Reduced 
Basis Landweber (RBL) method , see Algorithm [2] 

Remark 4.5. 


(i) The reduced bases IP tv, 1 , d' tv ,2 are orthonormalized to ensure numerical stability 
according to Remark lRR 

(ii) Computing Ajv(crf) is crucial regarding the total computational time of Algorithm 
0 We will elaborate in Section \4T\ 

(Hi) The alternative termination criterion in en guarantees that the reduced basis 
error stays very small. Due to f[T9jl . we expect Algorithm 0 to terminate as soon 
as the inner repeat loop terminates with ||F/v(crf) — u 5 \\l 2 (q.) A t5. 

(iv) A possible drawback of the alternative termination criterion could be the error 
estimator being inefficient, i.e., in the notation of Lemma \ 3. 1\ A^icrf)/ \\e\\ 
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Algorithm 2 RBL(cr start , r, Tjy ;2 ) _ 

1: 77/ . 0, CT o . CT start 1 ) y N ,\ ■■= span(^jv,i), Yn ,2 ■= span(\I > Nt2 ) 

2 : while ||F(crf) -u 5 \\ L 2 ^) > t5 do 
3: compute if n p as described in (|22| ) 

4: ^JV.l := Vn,1 U {-^’( cr n)}) ^JV,2 := ^N,2 U {'ifn, 2 } 

5: Y N \ = span{\l/jv,i}j Y N ,2 = span{^jv i2 } 

6: i ■= 1, erf := erf 

7: repeat 

8: compute s n< * as described in Procedure 14.61 

9: crf +1 := erf + ous n:i 

10: i i + 1 

11: until || Fat (erf) - w' 5 || L 2 (Q) < r<5 or Ajv(erf) > (r - 2)5 

12: crf +1 := erf 

13: n := n + 1 

14: end while 

15: return a RBL := erf 


being large. This could result in a premature termination of the repeat loop, wasting 
possible cheap repeat loop iterations and possibly causing more than necessary 
expensive while loop iterations. 

(v) Analogous to Algorithms Q] we write Orel to denote the element in V p 
corresponding to ctrbl- 

We want to elaborate on line 3 and 8 of Algorithm [2] with respect to our chosen 
model problem. Regarding the space update of Y/v, 2, we refer to Procedure 14.21 and 
choose snapshots of the dual problem for the basis update VVi ,2 of Y N 2 

enrich fy N) 2 with 2 = uf n solving flTTl) for l := u 5 — F(cr 5 n ). (22) 

The reduced Landweber update in line 8 of Algorithm [2] is done along the lines 
of Procedure 14.21 as well: for given spaces Y Nt 1 = span{^ 1)1; ..., X/v ,2 = 

span{^ 2 ,ij ■ ■ •, "02,^2} and current iterate erf, we replace the forward solutions of (ITTh 
and (ITTj) with their reduced counterpart. This is summarized in the following Procedure. 

Procedure 4.6. 

1. Compute Fv(crf) = u°jf the primal reduced basis approximation via (TT4l) using Yv,i 
as reduced basis space. Define l := u 5 — Ujf . 

2. Compute the dual reduced basis approximation u^ l = Y2jh u N 1 Wl ^ 1 u< ni = 
( uxij)fh solving the small linear system 

C a S 

B N (a i )u I ^ jl = rh N (l) with 

:= bftfaj, <h,k\ at), (m»(l)) ( := m(*p 2 j; <), j, k = 1,..., N 2 . 


( 23 ) 
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3. Evaluate the reduced Landweber update s n>i via 
( s n ,i) k = (u%) J Q k u a j !l , k = l,...,p, 
with Q k = b k ('il>i ji , being parameter independent. 

Since both reduced problems (TT4|) and fl23l) are offline/onlinc decomposable, i.e., the 
online phases are of complexity polynomial in N\ and Rj, independent of n 2 , and the 
matrices Q k , k — 1,.. .p, can be computed as soon as the reduced spaces are updated 
in line 4, the projected reduced Landweber method in the repeat loop from line 7 to 10 
can be implemented in an efficient and cheap way. It only consists of the online phases 
of (fl4|i and (1231) and the reduced Landweber update in step 3 of Procedure 14.61 In this 
sense the repeat loop is the online segment of Algorithm El where we elaborate on the 
computational cost of the error estimator A]y in the upcoming section. The remainder 
of the algorithm is then the offline segment since, with the enrichment of the reduced 
basis spaces, i.e., computing solutions of (TTT1) and (1171) . and the projection onto the new 
set of reduced basis spaces, it involves computations depending on n 2 . 

We conclude this section with final remarks about the RBL method. 

Remark 4.7. 

(i) For a fixed a G V v let {■,■)<? ■= b(-,-;a ) denote the energy scalar product 
and P a : Y —» Y/v,i the corresponding orthogonal projection. With Wyi = 
span{fji t i, ..., ifi .Ay} it holds for all i = 1 ,,N\ 

<P CT (F(a))-F(a),^ M >. = 0 
b(P rT (F(a )) - F(a),^ lti ;a) = 0 
^ b(P cr {F(a)),'ifi ! i] a) = /(V’i,*) 

such that P a o F(a) is a solution of (1T4h and therefore u a N = F^ia) = P a o F(a), 
since the solution of (TT4T) is unique. Using this and the fact that P a e L(Y. , Ljv,i) is 
an orthogonal projection, it is easy to see that F' N (a) = P a oF'(a) and (fori e Y N> 1 ) 
F' N (a)*l = F’(a)*(P*l) = F'(a)*l. Therefore, the reduced Landweber update 
s n ^ calculated in step 3 of Procedure \ j.6\ does not coincide with the expression 
F' N (<TtY(u‘-F N (<T i )) (see Procedure \j.2j . The consequence here is, that in general 
there is no closed expression of the iteration scheme of the RBL method. Instead, 
the main idea of the RBL method is to determine what kind of PDE solutions are 
required for the update of the Landweber method and replace them with suitable 
reduced basis approximations. 

(ii) In IWf Scherzer proposes a different methodology where a sequence {X N } Ne ^ 0 of 
nested subspaces of X (the infinite dimensional parameter space) with UveN 0 
being dense in X is employed. The orthonormal projection P N on those spaces 
is then used to develop a multi-level discrete Landweber method. In a similar 
approach is made for a steepest descent method in Banach spaces. As we can 
see our approach can not be formulated in such a way and the convergence theory 
developed in the mentioned works can not be adapted to the RBL method. 
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(Hi) Because of (i) and [ii), we postpone a theoretical investigation of the RBL method 
to future work. 

4.3. Experiments 

We want to compare Algorithms [1]&[2J To this end we choose a specific setting to which 
all experiments refer. We use the parameter space T900, n = 149 for the finite element 
space Y and want to reconstruct 

cr + (x ) := 3 + 2x n (i) (*) — 2xq(2)(x) x e 12 with subdomains 

12 (1) = [5/30, 9/30] x [3/30, 27/30] U ([9/30, 27/30] x ([3/30, 7/30] U [23/30, 27/30])), 

12 (2) = {x E 12 | ||(18/30, 15/30) t - *|| 2 < 4/30}. 

This is a piecewise constant function with background 3, contrast 2 on the C-shaped 
subdomain 12®) and contrast —2 on the disk 12®). The starting value a start = 3 as 
well as the function a + are visualized in the top left and bottom left of Figure [D The 
noisy measurement u 5 is generated in the following way: we compute the PDE-solution 
for <t + using Cornsol® and evaluate it at the nodes of the finite element space Y. 
Afterwards we add uniformly distributed random noise with a certain noise level. If not 
specified differently we add 1% relative noise (corresponding to 1.243 • 10 -4 absolute 
noise) and choose r = 2.5 in this section. Note that the noise is only added on 
the inner nodes of the discretization since we assume that the homogeneous Dirichlet 
data are known and measured correctly. The damping parameter 00 is heuristically 
chosen as w = ~(||F / (er start )||) _1 with the - resembling local uniform boundedness. 
Note that ||T v (cr siar , t )|| <C 1 such that lu actually serves as a speed-up of the iteration. 
The numerical experiments are done using Matlab® in conjunction with the libraries 
RBmatlab and KerMor, which both can be found onliiwjj]. 

In the following, three experiments will be carried out in the above full setting. 
Additionally, the same experiments are done for the (accordingly modified) versions of 
Algorithms Q] & [2] applied to the partial inverse problem (J5]) introduced in Remark 12.11 
In this partial setting, we use the same numerical setting as above but measure the 
data only on the subdomain 12 = [0,1] x [0,0.5], add 1% relative noise (corresponding 
to 8.786 • 1CT 5 absolute noise) and use lu = l(||-F , (<T start )||) _1 as damping parameter. 
Figures [T]& [2] as well as Table Q] contain results for both (partial and full) settings where 
our discussion will focus on the full setting. 

Figured] shows the reconstructions of a + in the full setting via Algorithm [2] in the 
top middle and via Algorithm d] in the bottom middle. In addition the reconstructions 
in the partial setting via Algorithm [2] in the top right and via Algorithm dl in the bottom 
right are shown, where the black box indicates the subdomain 12. 

Concerning the middle column, we cannot distinguish the two reconstructions 
visually from each other, which is also stated by \\(Jrbl ~ a Lw\\ l 2 (Q) ~ 1.118 • 10 -5 , 
such that both algorithms numerically yield the same reconstruction. The shape and 

f http://www.ians.uni-Stuttgart.de/MoRePaS/software/ 
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Figure 1. The reconstructions of <r + in the full setting via Algorithm [2] (top middle) 
and Algorithm [T| (bottom middle), as well as the starting value a sta rt (top left) and the 
exact value <r + (bottom left). The reconstruction in the partial setting via Algorithm 
[2] (top right) and Algorithm [T] (bottom right) including the subdomain P as a black 
box. 


location of as well as the contrast on hh 1 ) are well reconstructed. Regarding fA 2 ), only 
the location is well reconstructed. The contrast is not fitting everywhere and there is 
another small circular inclusion with opposite sign inside of fi( 2 h In the partial setting 
we have a good reconstruction on hi and some indications of a reconstruction close to 

n. 

Next, we want to compare the Algorithms with respect to the computational time: 
for Algorithm [l]we measure the total time, the amount of iterations until the discrepancy 
principle is reached and therefore the time per iteration, as well as the total amount 
of forward solves. Due to Procedure 14.21 both discretized problems (fill) and (fTTl) are 
considered here. For Algorithm [21 we are interested in the total time and therefore the 
speed up compared to Algorithm (H the amount of and the time per outer iteration (line 
2-14 excluding the repeat-loop from line 7 - 11), as well as the amount of and the time 
per inner iteration (one step of the repeat-loop from line 7 - 11) and again the total 
amount of high-dimensional forward solves. Table [T] contains the respective information. 

In the full setting the RBL method needs around 4 hours and the Landweber 
method needs around 52 hours of computational time resulting in a speed-up of 13. Due 
to ([2ip . the reduced spaces are very accurate such that the amount of inner iterations 
of Algorithm El roughly coincides with the amount of iterations of Algorithm [0 We 
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Setting 

time (s) 

ff Iterations 

time per Iter, (s) 

ff forward solves 

LW, full 

187189 

608067 

0.308 

1216134 



outer 

inner 

outer 

inner 


RBL, full 

14661 

20 

608083 

3.705 

0.024 

40 

LW, partial 

173759 

580129 

0.299 

1160258 



outer 

inner 

outer 

inner 


RBL, partial 

10638 

20 

580133 

3.670 

0.018 

40 


Table 1 . Runtime comparison of Algorithms |T| & [2] in the full and partial setting. 


want to highlight that Algorithm [2] only needed 40 expensive forward solves compared 
to the 1216134 forward solves required for Algorithm [[} If we look at the average 
iteration times of Algorithm [2l it becomes clear that sufficient inner iterations have to 
be made per outer iteration for Algorithm [2] to pay off in time. We will see in our next 
experiment that this is the case in the chosen setting. Regarding the average time per 
inner iteration, we have to mention our implementation of the error estimator (1T5|) : we 
do not use the offline/online decomposition presented in Procedure 13. Ill since this would 
result in each online phase to contain a vector-matrix-vector multiplication of dimension 
Q r = N] -p+1, with p = 900 and N\ = dim Yy,l• But the matrix in this multiplication is 
full as we can see in Corollary 13. 9 1 which prohibits this approach. Therefore, we compute 
the Riesz-representative and its norm in each inner iteration according to Lemma 13.71 
such that the online segment of Algorithm [2] is not completely independent of n 2 in this 
example and roughly 50% of the total computational time is spent in computing the 
error estimator in the inner loop. Hence, it might be interesting to develop termination 
criteria that still guarantee accurate reduced basis spaces but are less expensive. Similar 
conclusions can be drawn for the partial setting as it can be seen in Table [H 

In the third experiment we want to see that both Algorithms |T]& [2] behave the same 
way, with the latter simply being faster. To this end we define the nonlinear Landweber 
update s n Lw ■— F'(cr s n )*(u 5 — F(cr 5 n )) in addition to the update of the RBL method 
(here denoted by s n ^ RB i) described in Procedure 14.61 Figure [2] shows the update error 
|| s n ,RBL ~ Sn,Lw\\ L 2 (n) over the course of the iteration. The plot also includes a vertical 
dashed line whenever an outer iteration in Algorithm [2] is performed. 

We observe the expected behaviour: the more inner iterations of the RBL method 
are performed for a given set of spaces, the worse the update error gets until one of 
the termination criteria is met. Note that in this test the alternative termination 
criterion always triggered except in the very end where the reduced discrepancy principle 
is reached. With \\F N (cr RBL ) — F(cr RBL ) \\l 2 (Q) ~ 1-296 • 10 -8 and (fT9lh the high¬ 
dimensional discrepancy principle in line 2 of Algorithm [2] is then met as well and the 
whole algorithm terminates. According to Remark 14.51 this behaviour was expected. 
If we look at the iteration sequence in Figure [2] we can observe two further aspects: 
the more outer iterations are performed, the better the set of reduced spaces fits the 
region of the parameter space relevant for the solution of the inverse problem, resulting 
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Number of Iterations 


Figure 2. Update error \\s n ,RBL — s n ,Lw\\ l 2 (Q) over the course of the iteration for 
the full setting (top) and the partial setting (bottom). 


in the update error to decrease as a whole. Finally, the space updates are performed 
more frequently in the beginning of the iteration sequence (note the logarithmic scale 
of the iteration axis) to quickly adapt to the region of interest. Once the spaces are well 
suited, more and more inner iterations per outer iteration can be performed, resulting 
in Algorithm [2] to outperform Algorithm |Tj by more than an order with respect to the 
computational time. Again, similar observations can be made in the partial setting as 
it can be seen on the bottom of Figure [21 

In Remark 14.71 we justified the current lack of a theoretical investigation of the 
RBL method. Still, we can provide an experiment regarding its numerical regularization 
property. In the usual full setting the error \\(Jrbl— ct + || L 2 ^ is shown over the decreasing 
relative noise level 5 in Figure [3] 

By this we can conclude that a numerical regularization property is present for the 
RBL method. 

5. Conclusion 

For the problem of reconstructing the conductivity in the stationary heat equation it 
was investigated how reduced basis methods and the nonlinear Landweber method can 
be combined to reduce the overall computational time. A direct approach was shortly 
discussed to be inapplicable in the presence of high-dimensional parameter spaces. A 
new approach, the RBL method, was presented. It combined adaptive space enrichment 
of the reduced basis spaces with the nonlinear Landweber method. Using the RBL 
method, high-resolution images of the conductivity could be reconstructed, with the 
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0.5 1 2 3 4 5 10 

relative noise 8 in % 


Figure 3. Error \\ctrbl — o ’ + || L 2 ( n ) over the decreasing relative noise level <5. 


method being as accurate as the nonlinear Landweber method but roughly 13 times 
faster. Future work should contain a theoretical investigation of the RBL method 
including convergence theory as well as the application of its methodology to other 
inverse problems and more sophisticated regularization algorithms. 
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Appendix 

We prove the statement made in (|6|) of Section [2l 

For a G L+(fl) and k G L 2 (fl) with a + k G L 2 (Cl) let u a+K denote the 
corresponding solutions of 0, v a K the solution of (0 and c := ess inf (a). Note that u a 
solving ([3]) is equivalent to u a solving b(u a ,v]cr ) = f[y ) for all v G Hq(Q). It holds for 
all w G //,! (Q) 

/ (cr + /c)(Vu <T+K • Vw) — (o'Shf ■ Vw) dx = 0 




cr(V(n' 


gt+ac 


u a ) ■ X7w) dx = — kS7u ct+k ■ S7w dx. 


(A.l) 


The test function w = u a+K — u a in (IA.1D and the Holder inequality yield 


c\\V(u a+K -u 


,<j\ || 2 


I L 2 (Q) 


< / a(\/{u a+K - u a ) • V(u CT+K - u a ) dx 


nVu° +K ■ V(/ +K - u°) dx < ||«:||oo || Vn ff+ l i2(0) ||VK +K - u °)|| i2(n) 


^ \\V(u° +K -u")\\ L 2 {n) < 


pc 


II W 


(T+K, I 


I L 2 (Q)- 
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Similar arguments for cr + k and test function w = u a+K in (J2J) together with the 
inequality of Poincare-Friedrich and the notation c := || 11| z, 2 (o) yield 


c\\\7u a+K \\ 2 L2{a) < / (a + n)(Wu a+K ■ Vu a+K ) dx = - / 1 ■ u a+K dx < 
Jn Jn 

< C ■ C PF || Vu cr+h '|| L2(Q). 

Introducing the constant C' := C '^£ F we get 

||V(u cr+K — u a )\\< c"n^iioo- 
With (IA.2P and the dehnition of < in (J7J) it follows 


11 _, er+K 11 

L 2 (Q) \\U \\L 2 (n) 


(A.2) 


aX7(u 


cr+z-c 


u a ) ■ Vic — erV< • X7w dx = 


kS7u u+k ■ X7wdx + / KS7u a -Vwdx 


o- 


aV(u a+K - u a - <) • Vw dx — / W(« ff - u a+K ) ■ X7iu dx 


(A.3) 


in 


The test function w = u a+K 

<r-\- k, n ,<j n ,cr\ || 2 


flA.3|l . the Holder inequality and (1A.2I) yield 
e||VK+« -u°- <)|| h ia) < / <WK+“ - u" - O • V(0~ - u" - O dx 


Jn 

< IMUIVK - ii < ’ + “)|| L 2(n ) ||V(ti , ’ + " - u" - OH t 2, n) 
« ||VK+'‘- M '-o|| 1 2 (n) < llMUIVK-u'OMn) < jWIL- 
Using the inequality of Poincare-Friedrich again and introducing C" := CpF ' c we get 


\u 


cr-\-K, 


~u a ~ <|| L2(n) < C PF || - u° - <)|| L2(n) < C" ||k 


1 2 

I OO" 


Since C" is independant of n the statement follows 
\\T(o A-k) - F(a) - F(o)K\\ L 2 m 

inn - r, — r, -= hm 


K\ 


\n,<T + K n ,(J ^, cr 11 

IM -M -WlU 2 (f2) 

II II no 


r" iik-ii 2 

< lim = 0. 


>o pc 
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